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We study a system whose dynamics are governed by predictions of its future states. A general 
formalism and concrete examples are presented. We find that the dynamical characteristics depend 
on how to shape the predictions as well as on how far ahead in time to make them. We also report 
that noise can induce oscillatory behavior, which we call "predictive stochastic resonance". 

o 

INTRODUCTION 

o . 

Predictive behaviors are common in our everyday activities. A few examples include the timing of braking when 
driving a car, catching a ball, trading stock, and shaping population control policies. One of the main principles 
of normal dynamics is that the past and present decide the future. Most physical theories have been founded on 
this principle. It should be noted, however, that the idea of identifying a positron going forward in time with an 
electron "coming back from the future" has brought new insight to elementary particle physics . Given the common 
occurrence of making predictions, a consideration of the theoretical pictures of systems whose dynamics are explicitly 
governed by predictions or estimations of future states may be constructive. The main theme of this letter is to 
propose predictive dynamical systems by presenting concrete examples. The behavior of such dynamical systems 
£2 ' depends on how the predictions are made and on how far in advance they are made. We also report on that noise 
can induce oscillatory behavior, which we call "predictive stochastic resonance." 



(N 



T3 

o 
o 



- 1—1 

X 



MODEL AND ANALYSIS 

We start with the general differential equation of predictive dynamical systems, given by 



d ^= F {x{t),m- (i) 



Here, x(t) is the dynamical variable, and F(x) is the dynamical function. x(t) is a prediction of x at a future time 



CO 

t < i. This dynamical equation implies that the rate of change of x(t) depends not only on its current state, but also 

■ on the predicted future state x(t) through the dynamical function F. Naturally, when t = t, it reduces to the normal 
^sO \ dynamical equation. In this letter, we discuss the class of equations of the form 

^- = -ax(t) + f(x(t)) (2) 

with a constant a > for comparison with the corresponding delayed dynamical equations 

■ There is a variety of ways we can choose t and the prediction x(t). In this letter, we set i — t + rj with a parameter 
rj, which we call the "advance." In other words, the dynamics are governed by the predicted state of the dynamical 
variable a; at a fixed interval rj in the future. To predict x, we consider two cases. The first case is to extrapolate the 
dynamics for the duration of the advance rj with normal (rj — 0) dynamics, so that 



j-t+r, 

x(t = t + T))=J F(x(s))ds + x(t). (3) 

We call this the "extrapolate prediction." The second case is to assume that the current rate of change of x continues 
for the duration of the advance. This case is termed the "fixed rate prediction" and is given by 

x(t = t + v ) =r] ^-+x(t). (4) 

We examine how these different predictions, together with the value of rj affect the dynamics. We conducted 
our investigation by computer simulation. To avoid ambiguity and for simplicity, we consider time-discretized map 
dynamical models, which incorporate the above-mentioned general properties of the predictive dynamical equations. 
The general form of a predictive dynamical map is given as follows. 



x(t + l) = (l- n)x{t) + f(x{t + ri)) 



(5) 
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FIG. 1: Dynamical functions f(x) with parameters as examples of the simulations discussed in this letter, (a) Sigmoid function 
with /3 — 0.8. The straight line has a slope of a — 0.5. (b) Mackey-Glass function with /3 = 0.8 and n = 10. The straight line 
has slope of a = 0.1. 
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FIG. 2: Examples of fixed rate (left column) and extrapolate (right column) predictions for a sigmoid map with /i = 0.5 and 
/3 = 0.8. The initial condition is a;(0) = 0.5, and for predictive dynamics, x(l) = (1 — /i)x(0) + f(x(0)). The values of the 
advance rj are (a) 0, (b) 2, (c) 5, (d) 20, and (e) 80. 

where /i is a rate constant. The extrapolate prediction can be obtained by iterating the corresponding normal map 
(r) = 0) for the duration of 77. The fixed rate prediction is obtained by setting x(i — t + rj) = r)(x(t) — x(t — 1)) +x(t). 
The first model we consider is a "sigmoid" map (fig. 1(a)) with 
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This function is often used in the context of neural network modeling 0, 0] • We simulated this model with the 
extrapolate and with the fixed rate predictions. Some examples are shown in Fig. 2. In these examples, we have set 
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FIG. 3: Examples of fixed rate (left column) and extrapolate (right column) predictions for a Mackey- Glass map with /i = 0.5, 
P — 0.8, and n = 10. The initial condition is a;(0) = 0.5, and for predictive dynamics, a;(l) = (1 — /i)x(0) + f(x(0)). The values 
of the advance r\ are (a) 0, (b) 2, (c) 8, (d) 10, and (e) 20. 



the parameters /i and j3 to the same values in both prediction schemes. Given this parameter set, the origin x — is a 
stable fixed point when there is no advance, i.e., i] = 0. In the case of the extrapolate prediction, this property is kept 
even when r\ is increased. The situation is quite different for the case of fixed rate predictions. Here, an increasing r\ 
breaks the stability of the origin, and periodic behavior arises. 

A similar comparison can be made by setting the dynamical function to the "Mackey- Glass" map (Fig. 1(b)): 

f( x ) = (7) 
w 1 + x n w 

This function was first proposed for modeling the cell reproduction process, and it is known to induce chaotic behavior 
with a large delay |2J. Figure 3 shows the examples of the computer simulations we conducted. We can see that even 
though the extrapolate prediction does not change the stability of the fixed point with an increasing advance, the 
fixed rate prediction case gives rise to complex dynamical behavior. 

Now, we turn our attention to the effect of noise. The main motivation here stems from the fact that a combination 
of prediction dynamics and noise could lead to behaviors similar to "stochastic resonance" [H 0, 0|. Stochastic 
resonance has been studied in variety of fields 0, [TiL Il3l H3 . Hif . In particular, we have proposed a variation 
of stochastic resonance, called delayed stochastic resonance, which arises from a combination of noise with delayed 
dynamics 0,0,^^- We can infer from such an effect that a similar resonance behavior could be found in fluctuations 
in predictive dynamics. We shall see that this is indeed the case. 

The model we discuss is an extension of the sigmoid map model with fixed rate prediction. 

x(t + l) = (1- M )z(t)+ /(*(* + »,)) + *£(*), (8) 
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x(t = t + r}) = i](x(t) -x(t- 1)) + x(t), (9) 

/(*) = ~ L (10) 

Here, we have added a time-uncorrelated noise term £. £ takes a value between (—1, 1) with a uniform probability, 
and the parameter a controls its "width" or "strength". We have studied the behavior of this model with various 
parameter sets. A resonance type of behavior occurs for a parameter set whereby the dynamics is a simple monotone 
approach to a fixed point without noise (Figure 4). Without noise or with small noise, the behavior is a monotone 
approach to one of the fixed points or fluctuation around a point. As the noise width increases, we begin to see 
oscillatory behavior. They are seen both in the time series of x and in the associated power spectrum. With too 
much strength in noise, however, the oscillation begins to loose its regularity. The signal-to-noise ratio at the peak of 
the power spectrum is used as an indication of this resonant behavior(Figurc 4(f)). The signal-to-noise ratio reaches 
a maximum with a "tuned" noise strength. We note that as in delayed stochastic resonance, there is no external 
oscillatory forces or signals present in the system. The oscillation is due to the combination of the fixed rate prediction 
with appropriately chosen added noise. In this sense, it is a new kind of stochastic resonance. 



DISCUSSION 



Now, we would like to discuss a couple of issues related to the results of the predictive dynamical models. First, let 
us examine the difference in dynamical behavior between the extrapolate and the fixed rate predictions. Analytically, 
we can expand eq. @ around the fixed point to examine its stability. In particular, we can obtain the following from 
linear stability analysis: 

(l-(3r,)^- = (-a + 0)z(t), z^x-x*, /3=|u, (11) 

where x* is the fixed point. For the case of the fixed rate prediction, we can see that the advance, 77, can switch 
the stability. In the extrapolate prediction, on the other hand, the stability is not affected by the advance, provided 
that the corresponding normal dynamics monotonically approach the stable fixed point. (The details of this stability 
analysis will be discussed elsewhere.) Qualitatively, we can argue that the fixed rate predictions tend to "overshoot" 
in comparison with the extrapolation, leading to destabilization of the fixed point with a larger advance, rj. Higher 
order analysis and other analytical tools need to be developed to understand these types of equations and capture 
their dynamical behaviors. 

Second, we can compare our results with the case of delayed dynamics. In the case of delayed dynamics, we need 
to decide on the initial function and delay. Analogously, in predictive dynamics, the prediction scheme and advance 
need to be specified. Common to the delayed and predictive dynamical systems, both factors affect the nature of 
the dynamics. Also, as we have seen, we can have "predictive stochastic resonance" in a similar manner as delayed 
stochastic resonance. 

Finally, in the same way that we have considered random walks with a delay (delayed random walks'! [lfl l2(lj . 
random walks with a prediction (predictive random walk) can also be considered. Even with a small delay, delayed 
random walks give rather complex analytical expressions for statistical quantities, such as variance. Analogously, 
the analysis of predictive random walks is not straightforward. Mathematically, one may argue that these predictive 
dynamical and stochastic models can be cast into the framework of normal non-linear dynamical systems, as, after 
all, predictions are based on current and past states. Indeed, we can apply linear stability analysis to gain a partial 
understanding. However, in theoretical modeling, particularly for such fields as physiological controls, economical or 
social behaviors, and ecological studies, explicitly taking future predictions into account may be useful. For example, 
a recent study on humans performing stick balancing tasks on a fingertip has revealed that the corrective motion of 
the stick is frequently shorter than the neuro-physiological response time [21 . I22I Eil. Also, there is an indication 
that external physical or intentional fluctuations can lead to better balancing 24l l25l l26| . This is a task where both 
the feedback delay and predictions are intricately mixed. Models based on delayed dynamics have been proposed, but 
such models may be further developed by using predictive factors to investigate the experimental results. Models for 
this and other concrete applications have yet to be constructed and further analysis of predictive dynamical systems 
seems to be warranted. 




FIG. 4: Dynamics (left) and power spectrum (right) of predictive dynamical model with sigmoid map. This is an example 
of dynamics and associated power spectrum simulatied using the model of Eq. (8-10) with a variable noise strength a. The 
parameters are fi — 0.5, /3 = 2, 77 = 4, and the initial condition is x(0) = 0.5, and x(l) = (1 — n)x(0) + f(x(0)). The noise 
strengths are (a) a — 0.1, (b) a — 0.25, (c) a = 0.4, (d) a = 0.75, and (e) a — 1.0. The simulation is performed for L = 1024 
steps and 50 averages are taken for the power spectrum. The unit of frequency A is j-, and the power P(X) is in arbitrary units, 
(f) The signal-to-noise ratio S/N at the peak height as a function of the noise strength a. 
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